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I I , BACKGROUND 

t ' ^ ' ' 

I 

Because  of  their  complexity,  many  problems  of  operations  re- 
I search  or  management  science  cannot  be  examined  analytically,  but 

^ Instead  must  be  attacked  by  means  of  computer  simulation.  This  paper 

I V 

f discusses  the  task  of  obtaining  an  optimum  computer  simulation  solution, 

and  describes  a computer  program  for  aiding  In  this  task.  This  com- 
puter program  Incorporates  the  statistical  techniques  of  Response 
Surface  Methodology. 

! Throughout  this  paper,  a computer  simulation  will  be  regarded 

i as  a "black  box"  in  which  the  values  of  input  parameters,  or  factors, 

are  combined  In  some  manner  to  produce  output  parameters.  The  input 
parameters  may  be  classified  into  two  categories;  (1)  controllable 
I factors  and  (2)  uncontrollable  factors.  Controllable  factors  are  those 

Input  parameters  having  values  which  may  be  directly  controlled  by 
j the  appropriate  decision  maker  in  the  real  world.  Uncontrollable 

' factors,  on  the  other  hand,  are  those  input  parameters  over  which  the 

decision  maker  has  no  direct  control. 

I 

t , For  example,  in  a simulation  in  which  a U.  S.  Navy  task  force  is 

I protected  from  an  attacking  enemy  submarine  by  destroyer  escorts,  the 

I range  at  which  the  submarine  can  be  detected  is  a function  of  con- 

• trollable  factors  (such  as  speed,  bearing,  and  maneuverability)  de- 

I scribing  escort  tactics.  Factors  which  pertain  to  weather  conditions 

' and  the  submarine's  tactics  are  classified  as  uncontrollable. 

I The  specific  topic  addressed  in  this  paper  is  the  determination 

of  those  values  of  continuous  controllable  factors  which  produce  the 

I 
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optimum  value  of  one  output  parameter  of  interest.  It  should  be  J 

noted  that  there  are  two  basic  assumptions  in  this  problem  definition.  '] 

One  is  that  each  of  the  controllable  factors  is  continuous;  the  other 
is  that  the  optimum  value  of  a single  output  parameter  is  to  be  found. 

In  actual  practice,  the  former  assumption  may  be  relaxed  somewhat  in 

4 

I 

that  discrete  factors  may  be  considered  if  they  are  reasonably  approxi-  | 

mated  as  continuous. 

In  a sense,  this  type  of  problem-solving  situation  is  similar 
to  an  optimlaatlon  problem  to  be  solved  by  analytical  techniques 
(e.g.,  linear  programming).  The  major  difference  is  that  no  explicit 
objective  function  is  stated  and,  in  fact,  such  a function  exists 
only  implicitly  in  the  multitude  of  computer  instructions  in  the  pro- 
grams comprising  the  simulation.  Thus,  the  task  of  finding  the  best 
solution  cannot  rely  on  those  analytical  methods  which  depend  on  an 
explicit  objective  function. 

Methods  to  aid  in  the  quest  for  an  optimum  simulation  solution 
may  be  thought  of  as  comprising  two  general  types:  (1)  Internal 

methods  and  (2)  external  methods.  Internal  methods  are  those  methods 
which  involve  tinkering  with  the  inner  workings  (the  mathematical 
relationships  and  computer  programming)  of  the  simulation  black  box. 

Thus,  these  methods  are  incorporated  directly  into  the  black  box 

during  simulation  development.  ; 

There  are  a number  of  internal  methods.  For  example,  analytical 
techniques  of  optimization  may  be  programmed  for  use  in  selected 
portions  of  the  models.  Thus,  within  a restricted  section  of  the  model, 
an  optimum  may  be  identified,  subject  to  conditional  constraints. 
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Another  procedure  Involves  consideration  of  approximations  or  ex- 
pected values  Instead  of  dealing  directly  with  underlying  probability 
distributions.  This  procedure  may  restructure  the  model  to  make  it 
more  amenable  to  classical  optimization  techniques. 

Unlike  internal  methods,  external  methods  do  not  affect  develop-  j 

ment  of  the  mathematical  model  or  computer  programs  which  compose  the 
simulation  black  box,  and  are,  therefore,  independent  of  simulation 
construction.  These  methods  specify  search  strategies  or  decision 
rules  for  experimenting  with  different  values  of  the  controllable 

factors,  usually  using  the  output  of  the  black  box  as  feedback.  Al-  j 

though  a number  of  search  strategies  have  been  suggested,  there  are 
four  primary  techniques  which  serve  as  a basis  for  most  other  ones. 

These  are:  (1)  Factorial  Design,  (2)  Random  Search,  (3)  Single- 

Factor  method,  and  (4)  Response  Surface  Methodology  (RSM) . 

It  can  readily  be  seen  that,  because  of  their  independence  of 
both  the  mathematical  model  underlying  the  simulation  and  the  associated 
computer  programs,  external  methods  have  a much  wider  area  of  applic- 
ability than  do  internal  methods.  This  is  doubly  true  when  one  re- 
flects that  models  and  simulations  tend  to  evolve,  being  revised  at 
a number  of  stages.  In  view  of  this  situation,  an  internal  method 
incorporated  into  an  original  model  may  have  to  be  altered  or  deleted. 

In  addition,  should  someone  desire  to  use  an  existing  simulation 
in  an  attempt  to  determine  an  optimum  solution  to  some  problem,  the 
application  of  any  internal  method  would  require  that  the  computer 
programs  be  revised  and  modified.  On  the  other  hand,  external  methods 
could  be  used  without  any  changes  to  the  simulation  structure.  Further- 
more, optimization  in  the  simulation  situation  usually,  at  some  stage,  j 
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relies  on  external  methods  to  provide  a search  of  the  relevant  para- 
meter space. 

There  is  evidence  [6,7]  that  response  surface  methodology  (RSM) 
Is  the  external  method  which  offers  the  greatest  payoff  under  the 
assumptions  (continuous  controllable  factors,  single  output  to  be 
optimized;  that  have  been  made.  Thus,  this  paper  concentrates  on 
the  use  of  RSM  In  computer  simulation  situations. 
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11.  RESPONSE  SURFACE  METHODOLOGY 


Under  the  assumptions  mentioned  previously,  when  k controllable 
factors  are  Involved  in  the  simulation,  the  output  parameter  or  response 
lies  on  a surface  in  (k  + 1)  - dimensional  space  if  statistical  varia- 
tion is  disregarded.  This  surface  is  often  referred  to  as  the  response 
surface. 

The  basis  of  response  surface  methodology,  which  is  a blending 
of  statistical  experimental  design  and  regression  analysis,  was  de- 
veloped in  a paper  by  Box  and  Wilson  [1].  RSM  makes  use  of  the  initial 
assumption  that  the  response  surface  can,  in  any  local  region,  be 
well-approximated  by  a hyperplane.  That  is,  a good  approximation  to 
the  response  surface  in  any  locality  is  given  by  the  equation 


a + Z oijXj 
o 1 i 


If  an  experimental  region  (i.e.,  a locality)  is  defined  by  the 
boundaries  L^  £ £ U^,  i = l,...,k,  it  is  often  convenient  to  code 

the  largest  value  of  each  factor  as  + 1 and  the  smallest  value  of  each 


factor  as  - 1.  For  example,  if  factor  were  to  be  investigated  in 


the  interval  20  £ X^  £ 60,  the  coding  would  be  given  by 


X -40 

V = J.  - 

j 


20 


so  that  Xj  = -1  is  equivalent  to  X^  = 20,  and  x^  = + 1 is  equivalent 


to  X,  = 60.  If  the  factors  X^^,...,X^ 


are  transformed  into  the  coded 
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factors  In  this  manner,  the  equation 


a + I a.X, 
o ^ 1 1 


Is  transformed  Into  the  equation 


Thus,  an  estimate  y of  the  value  of  the  response  y at  the  coded  point 
(Xj^, . . . ,Xj^)  would  be  given  by 

k 

y = bo  + I b^x^  , 

Ic~p 

where  b^,  obtained  from  an  initial  experiment  (usually  a 2 ^ fractional 

factorial  [2,3,5])  by  least  squares,  is  an  estimate  of  3^. 

The  estimates  (b^^ , . . . ,bj^)  determine  the  estimated  gradient 
direction  known  as  the  path  of  steepest  ascent.  This  path,  which 
provides  the  approximate  direction  of  predicted  maximum  response,  is 
followed  until  there  is  no  improvement  in  the  observed  response,  at 
which  time  the  whole  process  may  be  repeated,  usually  within  a smaller 
experimental  region. 

When  the  initial  assumption  of  an  approximating  hyperplane  no 
longer  appears  valid,  additional  experiments  may  be  conducted  to 
estimate  the  curvature  of  the  response  surface.  The  usual  design  in 
this  situation  is  a central  composite  design  [2,3,5],  which  may  be 
constructed  by  adding  axial  points  to  an  existing  fractional  factorial. 


J 


- 6 - 


If  necessary,  ridge  analysis  [4]  may  be  used  to  continue  optimum- 
seeking on  the  approximating  curved  (l.e.,  second  order)  surface. 
Ridge  analysis  is  the  analogue  of  the  steepest  ascent  procedure  used 
in  conjunction  with  the  hyperplane  (i.e.,  first  order)  approximation. 
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III.  A COMPUTER  PROGRAM  FOR  AUTOMATED  RSM 


Because  of  the  Independence  of  RSM  from  the  underlying  simula- 
tion, it  is  possible  to  automate  its  application  to  a large  extent. 

Such  automation  eliminates  the  requirement  that  a person  applying  RSM 
techniques  must  be  relatively  knowledgeable  about  their  underlying  statis- 
tical and  mathematical  bases. 

The  following  sections  of  this  paper  describe  an  automated  RSM 
computer  program^  which  is  now  available  to  simulation  users.  This  pro- 
gram, which  may  be  used  for  constrained  or  unconstrained  optimum- 
seeking in  conjunction  with  deterministic  or  Monte  Carlo  simulations, 
should  prove  valuable  in  obtaining  improved  simulation  solutions, 
while  at  the  same  time  reducing  analyst  effort  and  shortening  overall 
time  to  solution.  In  addition,  and  somewhat  paradoxically,  optimum- 
seeking  by  means  of  the  RSM  program  may  often  result  in  a smaller  in- 
vestment in  total  computer  time  than  that  required  by  an  analyst's 
manual  search  involving  the  same  number  of  simulation  runs.  This  sur- 
prising situation  occurs  because  execution  time  for  the  program  tends  to 
be  less  than  the  corresponding  time  requirements  of  repetitive  simu- 
lation loading  and  input  processing  In  the  manual  mode. 

The  automated  RSM  program,  which  can  process  up  to  15  controllable 

2 

factors  subject  to  a maximum  of  25  linear  constraints,  is  coded  as 
a maximizing  program.  It  treats  a minimization  problem  by  changing 


^Developed  under  Office  of  Naval  Research  Contract  No. 
N0001A-74-C-01A8. 

2 

A larger  number  of  controllable  factors  and/or  constraints 
may  be  processed  if  the  dimensions  of  the  appropriate  arrays  in  the 
program  are  increased. 
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the  sign  of  all  responses  obtained  and  maximizing  the  changed 


responses.  That  la,  the  program  maximizes  the  negative  of  the 
original  responses.  (All  Information  printed  as  output  is,  however, 
in  terms  of  the  original  responses.) 

Two  versions  of  the  RSM  program  are  available.  One,  labeled 
RSMC,  Is  for  problems  in  which  there  are  linear  constraints  on  the 
Input  parameters.  The  other,  labeled  RSMU,  Is  a shorter  version 
designed  for  problems  involving  unconstrained  optimum-seeking.  Each 
version  of  this  American  National  Standard  FORTRAN  IV  program  is 
designed  to  function  as  an  executive  program  which  may  be  easily 
interfaced  with  an  existing  FORTRAN  simulation. 

Program  version  RSMU,  which  is  composed  of  a main  program  and 
24  subroutines  on  1690  cards  (including  454  comment  cards) , requires 
23,280  bytes  of  core  memory  on  the  IBM  370/Model  168  when  using  the 
FORTRAN  IV  (H)  compiler.  The  RSMC  version,  which  consists  of  a main 
program  and  30  subroutines  on  2349  cards  (including  604  comment  cards), 
requires  32,148  bytes. 

The  automated  RSM  program  incorporates  the  general  RSM  pro- 
cedures described  in  the  previous  section.  In  addition  to  permitting 
optimum-seeking  subject  to  user-specified  constraints  on  the  con- 
trollable factors,  the  program  also  allows  the  user  to  conduct  the 
RSM  search  in  suitably-sized  blocks  of  simulation  runs  to  permit 
flexible  scheduling  of  computer  processing  time. 

The  following  sections  summarize  the  automated  RSM  program.  More 
detailed  information  about  the  program  is  provided  in  two  volumes 
[8,9]  of  a report  which  serves  as  a user's  guide.  Both  volumes  are 
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available  from  the  National  Technical  Information  Service  (NTIS). 

Copies  of  the  program  may  be  obtained  from  Desmatlcs,  Inc. 

A.  PROGRAM  DESCRIPTION 

The  automated  RSM  program  comprises  a number  of  subroutines  which 
are  required  for  conducting  the  optimum-seeking  search.  This  search 
consists  of  five  phases: 

(1)  First-order  design  phase 

(2)  Steepest-ascent  phase 

(3)  Factor  screening  phase 

(4)  Second-order  design  phase 

(5)  Ridge  analysis  phase. 

The  first-order  design  phase  generates  a 2^  ^ fractional 
factorial  of  minimal  size  to  permit  a first-order  (i.e.,  hyperplane) 
approximation  to  the  response  surface.  Using  the  results  of  these  runs, 
this  phase  calculates  the  path  of  steepest  ascent.  The  steepest  ascent 
phase  then  monitors  simulation  runs  along  this  path.  When  runs  on  the 
path  fail  to  provide  improvement  in  observed  response,  control  returns 
to  the  first-order  design  phase,  which  generates  a new  fractional 
factorial  about  the  point  (i.e.,  the  controllable  factor  values)  which 
yielded  the  best  observed  response. 

When  the  fractional  factorials  are  found  not  to  provide  a reason- 
able path  of  steepest  ascent  because  of  an  unsuitable  approximation  to 
the  response  surface,  the  second-order  design  phase  is  entered.  This 
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module  augments  the  existing  fractional  factorial  with  additional  simu- 
lation runs  in  order  to  form  a central  composite  design  which  permits 
estimation  of  quadratic  effects  (l.e.,  curvature  of  the  response 
surface) . Using  the  observed  responses  obtained  from  the  simulation 
runs  in  this  design,  the  ridge  analysis  phase  guides  the  search  for  an 
improved  solution  by  means  of  ridge  analysis. 

The  factor  screening  phase  permits  efficiency  in  the  expenditure 
of  simulation  runs  in  later  stages  of  the  search  for  an  Improved 
solution.  This  is  accomplished  by  eliminating  from  consideration  those 
controllable  factors  which  were  observed  in  the  first-order  design 
phase  to  have  little  or  no  effect  on  the  observed  response.  Because 
the  fractional  factorial  provides  an  estimate  of  the  effect  that  each 
factor  has  on  the  observed  response,  the  relative  importance  of  each 
factor  is  judged  by  comparing  its  estimated  effect  with  its  estimated 
standard  error,  which  is  also  obtained  from  the  fractional  factorial. 

If  the  estimated  effect  is  larger  than  its  estimated  standard  error, 
the  factor  is  retained  in  the  search.  Otherwise,  the  factor  is  set 
equal  to  the  value  corresponding  to  the  simulation  run  which  has  pro- 
duced the  best  observed  response,  and  is  not  varied  in  succeeding 
stages  of  the  search. 

A constraint  option  is  available  for  specifying  linear  constraints 
on  the  controllable  factors.  Should  constraints  be  specified,  the 
program  conducts  its  search  subject  to  them.  When  a constraint  is 
encountered  within  a fractional  factorial  or  a central  composite 
design,  the  complete  design  is  shifted  away  from  the  violated  constraint. 
When  a constraint  is  encountered  while  runs  are  being  made  on  a search 
path,  the  search  direction  is  revised  so  that  it  lies  in  the  restrictive 
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hyperplane  deflnecj  by  the  constraint, 

Although  the  complete  RSH  search  may  be  conducted  within  a 
single  run  of  the  automated  program,  use  of  the  restart  option  permits 
the  user  to  have  the  search  made  in  blocks  of  runs.  This  option 
provides  flexibility  in  scheduling  computer  time  and  protects  the  pro- 
cessing Investment  in  the  event  of  errors  in  the  data  input.  After  the 
last  simulation  run  in  a block,  a file  of  pertinent  data  is  created. 
Using  this  restart  data  file  as  input  to  the  RSM  program,  the  user  may 
resume  optimum-seeking  by  continuing  the  processing  of  simulation  runs. 
The  overall  RSM  search  may  be  restarted  any  number  of  times  at  any 
phase . 

B.  PROGRAM  INTERFACE  AND  DATA  INPUT 

The  automated  RSM  program  begins  its  optimum-seeking  with  k 

controllable  factors  under  investigation  and  a maximum  of  n 

points  in  the  k-dimensional  space  to  be  run  in  the  simulation  with  m 
Iterations  at  each  point.  In  other  words,  each  of  the  n points  in 
the  k-dimensional  factor  space  determines  the  values  of  the  controllable 
factors  for  which  a simulation  run  consisting  of  m iterations  is  to  be 
made.  In  a deterministic  simulation  where  no  random  variation  exists 
in  responses  observed  at  the  same  point,  only  one  iteration  (m  = 1) 
would  be  used.  For  a Monte  Carlo  simulation,  however,  random  variation 
does  exist  in  responses  observed  at  the  same  point.  To  contend  with 
this  random  variation,  several  iterations  (m  > 1)  may  be  used  to 
obtain  an  average  observed  response  at  each  of  the  n points. 
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To  apply  the  automated  RSM  program,  the  user  must  input  values 


of  k.,  m,  and  n,  an  Initial  point  for  the  search,  and  a step  size 
for  each  factor  X^,  1 = l,,,.,k.  In  addition,  the  program  must 
be  Interfaced  with  the  simulation  to  which  it  is  to  be  applied.  This, 
however,  is  a relatively  straightforward  task,  which  requires  that  the 
response  and  all  controllable  factors  occur  in  COMMON  statements  within 
the  simulation.  This  may  require  defining  new  COMMON  statements,  if 
necessary. 

A short  interface  routine  must  also  be  prepared.  Upon  entry 
to  the  simulation,  this  routine  should  define  the  values  of  the 

factors  to  be  used  in  the  simulation  run.  Upon  exit  from  the  simu- 
lation, the  routine  should  define  the  value  of  the  observed  response 
to  be  used  in  the  RSM  program. 

Input  to  RSMU,  the  program  version  for  unconstrained  optimum- 
seeking,  consists  of: 

(1)  A master  parameter  card  which  supplies  information 
about  the  search  to  be  conducted  and  the  options 
desired 

(2)  A set  of  design  specification  cards,  which  contain  in- 
formation from  which  the  initial  fractional  factorial 
design  is  constructed. 

RSMC,  the  version  for  constrained  optimum-seeking,  requires  an 
additional  set  of  constraint-specification  cards.  On  a run  where 
restart  input  is  used  (for  either  RSMU  or  RSMC),  only  a new  master 
parameter  card  is  required  in  addition  to  the  existing  restart  data 
file. 


IB 


13  - 


c. 


PROGRAM  OUTPUT 


For  each  simulation  run  that  Is  made,  the  RSM  program  provides 
output  which  includes  the  observed  responses  for  each  of  the  m Itera- 
tions comprising  a simulation  run,  the  average  observed  response  for 
that  run,  the  values  of  the  controllable  factors  corresponding  to 
that  run,  and  an  Indication  when  the  response  Is  the  "best"  (maximum 
on  the  k-dlmenslonal  surface)  that  has  been  observed.  In  addition, 

RSMC  (the  version  for  constrained  optimum-seeking)  prints  the  constraints 
Inputted  by  the  user  and  provides  Information  pertinent  to  constraint 
processing.  The  final  output  at  the  conclusion  of  the  search  consists 
of  the  best  observed  response  and  the  corresponding  factor  values. 

Instead  of  a detailed  description  of  the  RSM  program  output, 
this  section  presents  two  simple  examples  of  RSM  application  to  illustrate 
the  type  of  printed  output  provided  by  RSMU  and  RSMC.  It  should  be 
noted  that  in  the  examples,  explicit  mathematical  function  were  used 

as  the  "simulations"  for  which  an  optimum  solution  was  to  be  found.  ’ 

The  use  of  known  functions,  rather  than  simulations  Involving  unknown 

response  surfaces,  provides  normative  information  which  may  prove 

valuable  to  the  potential  user  in  examining  the  automated  RSM  program 

output . 

1.  Example  No.  1 

The  first  example  uses  the  response  surface 

y - 10  (~2xf  + - 4X.X,  + 96X,  + 48X,  - 960) 

4 5 4 5 4 5 

- 14  - 

^ j 


as  a deterministic  "simulation",  Input  data  to  the  RSMU  program 
version  defined  an  unconstrained  maximum-seeking  problem  involving 
five  controllable  factors. 


The  starting  point  for  the  search  was  given  as 

(X^,  X2,  Xj,  X^,  X5)  = (10.0,  10.0,  0.0,  0.0,  0.0) 

with  corresponding  step  sizes 

(A^,  hy  A^,  A^)  = (1.0,  1.0,  2.0,  2.0,  2.0). 

An  upper  limit  of  30  simulation  runs  of  one  Iteration  each  was  speci- 
fied, with  all  30  runs  to  be  made  in  one  pass  of  the  RSMU  program.  It 
should  be  noted  that  the  response  surface,  which  is  determined  by  X^ 
and  X^  only,  is  a saddle  surface  centered  at  the  point  X^  = 16.0, 

X^  - 8.0. 

An  examination  of  the  RSMU  output  shows  that  an  initial  fractional 
factorial  involving  the  five  factors  was  used  to  determine  the  steepest 
ascent  path.  Simulation  runs  corresponding  to  points  on  this  path  were 
made  until  there  was  no  improvement  in  the  observed  response.  When 
this  lack  of  improvement  occurred,  the  factors  were  examined  to  deter- 
mine whether  any  might  be  of  minor  Importance  and  thus  be  eliminated 
from  further  consideration.  Based  on  this  examination,  factors  Xj^,  X2, 
and  X^  were  inactivated  before  a new  fractional  factorial  was  constructed. 
Information  from  this  design  revealed  that  the  assumption  of  a first 
order  (hyperplane)  approximation  was  not  reasonable. 

Because  of  thie,  a second  order  surface  was  fit,  with  the  search 
continuing  by  .neans  of  ridge  analysis.  Thus,  by  entering  the  second 


I 
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order  ph^se,  the  RSMU  program  avoided  having  the  search  end 
erroneously  in  the  vicinity  of  the  saddle  point,  despite  the 
fact  that  the  initial  steepest  ascent  path  directed  the  search  to 
that  region. 

The  following  pages  exhibit  the  output  produced  by  RSMU  for 


this  problem. 


OftSFUVED  RESPONSES  ON  THE  » ITERAflONS 

-O.IOAAOOE  05 
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TOT*L  OF  30  RUMS,  FFCH  AVERAGING  OVER  I nfRATICNS  OF  SIHUIATION.  VIEIO 
optimum  OBSERVED  RESPONSE*  0.U0V9RE  OA  FOR  30  TH  RUN  MITh  VALUES  LF  *( 


f 

[ 

2.  Example  No.  2 

I I 

I The  second  example  uses  the  response  surface 

! y - 100  - (X^  - 1)^  - (Xj  + 2)^  - (X^  - 10)^  + e 

as  a "slnjulatlon",  where  e Is  a random  error  term  generated  from  a 
Normal  distribution  with  mean  p » 0 and  standard  deviation  o - 2. 

This  value  of  the  standard  deviation  is  equivalent  to  20%  of  the  true 
response  at  the  starting  point  for  the  search. 

j Input  data  to  the  RSMC  program  version  defined  a maximum-seeking 

[ 

problem  involving  four  controllable  factors,  subject  to  the  following 
six  constraints: 

1.5  - 2Xj^  + 3X^  ^ 0 (Constraint  No.  1) 

1.5  - Xj^  + X^  > 0 (Constraint  No.  2) 

' -7.0  + 5Xj^  ~ Xj  i 0 (Constraint  No.  3) 

7.0  - X^  ^ 0 (Constraint  No.  4) 

7.0  - X^  ^ 0 (Constraint  No.  5) 

X^  0 (Constraint  No.  6) 

The  starting  point  for  the  search  was  given  as 
(X^,  X2,  X^,  X^)  = (5.0,  5.0,  5.0,  5.0) 
with  corresponding  step  sizes 

I (dj^,  A^)  = (0.5,  0.5,  0.5,  0.5). 


; 
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An  upper  limit  of  30  simulation  runs  of  two  Iterations  each  was  speci- 
fied, with  all  30  runs  to  be  made  In  one  pass  of  the  RSMC  program. 

It  can  be  verified  that  the  true  maximum  value  on  the  response 
surface  Is  84.50  corresponding  to  the  point 

(1.50,  X^,  0.50,  7.00) 

where  X^  may  assume  any  value.  This  point  lies  at  the  Intersection  of 
the  first,  third,  and  fourth  constraints  listed  above. 

The  RSMC  output  shows  that  the  steepest  ascent  path  resulting 
from  the  Initial  fractional  factorial  was  followed  until  constraint 
No.  4 was  encountered.  At  that  time,  the  revised  path  direction  was 
determined  and  then  followed  until  constraints  No.  1 and  No.  2 were 
hit.  The  constrained  path  direction  was  again  calculated  and  followed 
until  constraint  No.  3 was  encountered.  Because  no  further  success 
was  predicted  In  the  path  direction  resulting  from  consideration  of 
constraint  No.  3,  the  search  was  terminated.  The  point  Identified  as 
optimum  by  RSMC  was 

(1.51,  4.24,  0.53,  7.00) 

which  corresponded  to  an  observed  response  of  84.60.  Because  of  the 
presence  of  random  error,  the  observed  response  at  this  point  differs 
from  the  true  response,  which  Is  84.34. 

The  following  pages  exhibit  the  output  produced  by  RSMC  for 
this  problem. 
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OBSERVED  RESPONSES  ON  THE  2 ITERATIONS 


AVEPACE  OnSEPVEO  RESPONSE  FOR  THIS  POINT  IS  0.669S16E  02  THIS  IS  THE  OPTINUH  RESPONSE  THUS  FAR 


GOING  mwARO  CONSTRAINT  NO 
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